Information reproducing device having error informing means

ABSTRACT

In a system for printing and recording multimedia information on an information recording medium in the form of an optically readable code pattern, reading the code pattern and restoring the original multimedia information, the code pattern of the information recording medium includes processing information necessary for editing and processing data according to the restoration processing procedure for restoring the multimedia information. Further, the restoration processing procedure includes a hierarchical structure of layers 1 to 5 and an application process. In the layer 5 and application process, a set specification identifier determining section selects the decoding section, selects the reproducing output section and sets parameters according to the set specification name identifier and SDCH supplied as header information prior to user data of the subset from the layer 4.

This is a continuation, application Ser. No. 09/022,872 filed Feb. 12,1998 now U.S. Pat. No. 5,999,665 which is Divisional Application of08/527,405 filed Sep. 13, 1995, now U.S. Pat. No. 5,754,687.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates to an information recording medium such as paperfor recording so-called multimedia information containing audioinformation such as voices and music, video information obtained by acamera, video device or the like, and digital code data obtained by apersonal computer, word processor or the like in the form of anoptically readable code pattern, and an information reproducing devicefor optically reading a code pattern recorded on the informationrecording medium and reproducing the original multimedia information.

2. Description of the Related Art

Conventionally, as recording media for recording voices and music,various types of media such as a magnetic tape and optical disk areknown. However, the unit price of such media is expensive to some extenteven if a large number of duplicates thereof are made, and a large spaceis required for storing such media. Further, in a case where it becomesnecessary to give a medium having recording sounds thereon to anotherperson in a remote place, a lot of labor and time is taken either whenit is sent by post or when it is directly handed over. This is also trueof so-called multimedia information containing video informationobtained by a camera, video device or the like, and digital code dataobtained from a personal computer, word processor or the like other thanaudio information.

Therefore, there has been proposed a system for recording multimediainformation containing at least one of audio information, videoinformation, digital code data on an information recording medium suchas paper in the form of dot code as coded information or imageinformation which can be sent by facsimile transmission and which can beduplicated in large quantities at low cost and a system for reproducingthe information, as disclosed in International Application No.PCT/JP93/01377 (International Application KOKAI Publication No. WO94/08314) corresponding to U.S. Pat. No. 5,896,403.

In the information reproducing system in the above InternationalApplication, a method of holding by hand an information reproducingdevice for optically reading and reproducing dot codes on theinformation recording medium, and manually scanning the device on therecording medium along the dot codes to read the dot codes is disclosed.

However, the dot code pattern itself remains in a stage in which thestructure for enhancing the recording density is studied, and theinformation reproducing device and information recording medium in theabove International Application are provided without fully taking intoaccount flexability for change into consideration.

Further, it is also desired to stably reproduce the code patterndisclosed in the above International Application at high speed.

SUMMARY OF THE INVENTION

This invention has been made in order to solve the above problems, andan object of this invention is to provide an information recordingmedium and information reproducing device capable of stably reproducingcode patterns at high speed and dealing with code patterns even if thecode pattern structure itself is changed in the future.

According to one aspect of this invention, there is provided aninformation reproducing medium having a portion in which multimediainformation containing at least one of audio information, videoinformation and digital code data is recorded in the form of anoptically readable code pattern, the information recording medium beingapplied to restoring means for reading the code pattern and restoringthe original multimedia information, the restoring means comprising:

first hierarchical processing means for converting the code pattern thusread into code data as an image, adding information relating to thereading to the code data as first processing information, and outputtingthe resultant information;

second hierarchical processing means for recognizing the firstprocessing information output from the first hierarchical processingmeans, processing code data output from the first hierarchicalprocessing means, creating blocks by collecting the code data for eachpreset unit, and outputting the blocks;

third hierarchical processing means for collecting the blocks outputfrom the second hierarchical processing means, extracting secondprocessing information at least necessary for creating supermacro-blocksof a larger preset unit from the code data of the blocks, recognizingthe second processing information, creating supermacro-blocks based onthe second processing information, extracting third information foreffecting the error processing operation from the supermacro-blocks,recognizing the third processing information, effecting the errorprocessing operation for the supermacro-blocks based on the thirdprocessing information, and outputting subset elements created bydistributing the supermacro-blocks based on the third processinginformation;

fourth hierarchical processing means for extracting fourth processinginformation at least necessary for creating subsets constructed codes ofpreset unit which can permit the multimedia information to be restoredfrom the subset elements output from the third hierarchical processingmeans and outputting subsets created based on the fourth processinginformation; and

fifth hierarchical processing means for extracting fifth processinginformation at least necessary for creating reproducing data forreproducing and outputting the multimedia information from the subsetsoutput from the fourth hierarchical processing means and outputtingreproducing data of the multimedia information based on the fifthprocessing information, and wherein

the code pattern contains at least the second to fifth processinginformation for executing the application process for adequatelyselecting and outputting reproducing data from the fifth hierarchicalprocessing means for the respective data types based on the fifthprocessing information.

According to another aspect of this invention, there is provided aninformation reproducing device for optically reading a code pattern froman information recording medium having a portion in which multimediainformation containing at least one of audio information, videoinformation and digital code data is recorded in the form of anoptically readable code pattern and restoring the original multimediainformation, comprising:

first hierarchical processing means for converting the code pattern thusread into code data as an image, adding information relating to thereading as first processing information to the code data and thenoutputting the same;

second hierarchical processing means for recognizing first processinginformation output from the first hierarchical processing means toprocess code data output from the first hierarchical processing means,creating blocks by collecting the code data for each preset unit, andoutputting the blocks;

third hierarchical processing means for extracting second processinginformation at least necessary for creating supermacro-blocks of alarger preset unit by collecting the blocks output from the secondhierarchical processing means from the code data of the blocks,recognizing the thus extracted second processing information, creatingsupermacro-blocks based on the second processing information, extractingthird processing information for effecting the error processingoperation from the supermacro-block, recognizing the thus extractedthird processing information, effecting the error processing operationfor the supermacro-block based on the third processing information, andoutputting subset elements created by distributing the supermacro-blocksbased on the third processing information;

fourth hierarchical processing means for extracting fourth processinginformation at least necessary for creating subsets constructed by codesof a preset unit which permits the multimedia information to be restoredby use of the subset elements output from the third hierarchicalprocessing means from the subset element and outputting subsets createdbased on the fourth processing information;

fifth hierarchical processing means for extracting fifth processinginformation at least necessary for creating reproducing data forreproducing and outputting the multimedia information from the subsetsoutput from the fourth hierarchical processing means and outputtingreproducing data of the multimedia information based on the fifthprocessing information; and

application process means for adequately selecting and outputtingreproducing data from the fifth hierarchical processing means for therespective data types based on the fifth processing information.

According to still another aspect of this invention, there is providedan information reproducing device for optically reading a code patternfrom an information recording medium having a portion in whichmultimedia information containing at least one of audio information,video information and digital code data is recorded in the form of anoptically readable code pattern and restoring the original multimediainformation, comprising:

first hierarchical processing means for converting the code pattern thusread into code data as an image, adding information relating to thereading as first processing information to the code data, and thenoutputting the same;

second hierarchical processing means for recognizing first processinginformation output from the first hierarchical processing means toprocess code data output from the first hierarchical processing means,creating blocks by collecting the code data for each preset unit, andoutputting the blocks;

third hierarchical processing means for extracting second processinginformation at least necessary for creating supermacro-blocks of alarger preset unit by collecting the blocks output from the secondhierarchical processing means from the code data of the blocks,recognizing the thus extracted second processing information, creatingsupermacro-blocks based on the second processing information, extractingthird processing information for effecting the error processingoperation from the supermacro-block, recognizing the thus extractedthird processing information, effecting the error processing operationfor the supermacro-block based on the third processing information, andoutputting subset elements created by distributing the supermacro-blocksbased on the third processing information;

fourth hierarchical processing means for extracting fourth processinginformation at least necessary for creating subsets constructed by codesof a preset unit which permits the multimedia information to be restoredby use of the subset elements output from the third hierarchicalprocessing means from the subset element and outputting subsets createdbased on the fourth processing information;

fifth hierarchical processing means for extracting fifth processinginformation at least necessary for creating reproducing data forreproducing and outputting the multimedia information from the subsetsoutput from the fourth hierarchical processing means and outputtingreproducing data of the multimedia information based on the fifthprocessing information; and

application process means for adequately selecting and outputtingreproducing data from the fifth hierarchical processing means for therespective data types based on the fifth processing information, andwherein

the fifth hierarchical processing means includes error alarming meansfor effecting the error alarming process according to the fifthprocessing information.

According to another aspect of this invention, there is provided aninformation reproducing device comprising:

scanning means for optically reading a code pattern from an informationrecording medium having a portion in which multimedia informationcontaining at least one of audio information, video information anddigital code data is recorded in the form of an optically readable codepattern;

restoring means for restoring the code pattern read by the scanningmeans into original multimedia information; and

error informing means for informing occurrence of error when theoriginal multimedia information cannot be restored by the restoringmeans while determining whether the cause of non-reproduction is causedby an error occurring in the processing process by the scanning means orrestoring means or by the fact that the information reproducing deviceis not applicable to the code pattern read by the scanning means.

Additional objects and advantages of the invention will be set forth inthe description which follows, and in part will be obvious from thedescription, or may be learned by practice of the invention. The objectsand advantages of the invention may be realized and obtained by means ofthe instrumentalities and combinations particularly pointed out in theappended claims.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate presently preferred embodiments ofthe invention and, together with the general description given above andthe detailed description of the preferred embodiments given below, serveto explain the principles of the invention.

FIG. 1A and FIG. 1B are diagrams showing the format of a dot code;

FIG. 2 is a diagram showing an example of hierarchical segmentation of ainformation transfer protocol in a multimedia paper system;

FIGS. 3A and 3B are diagrams showing an example of the construction of ahierarchical structure on the reproducing side;

FIG. 4 is a block construction diagram of the layer 5 and theapplication process in the first embodiment;

FIG. 5 is a diagram showing an example of the file structure of a subsetsupplied from the layer 4;

FIG. 6 is a flowchart for illustrating the operation of reproducingprocess in the first embodiment;

FIG. 7 is a flowchart for illustrating the set specification nameidentifier determining process in detail;

FIG. 8 is a flowchart for illustrating the error process in the firstembodiment in detail;

FIG. 9 is a flowchart for illustrating the decode mode and thereproducing parameter setting process in the first embodiment in detail;

FIG. 10 is a block construction diagram showing the layer 5 and theapplication process in the second embodiment;

FIG. 11 is a flowchart for illustrating the operation of the reproducingprocess in the second embodiment;

FIG. 12 is a diagram showing an example of the file structure of asubset supplied from the layer 4 in the third embodiment;

FIG. 13 is a flowchart for illustrating the decode mode and thereproducing parameter setting process in the third embodiment in detail;

FIG. 14 is a block construction diagram showing the layer 5 and theapplication process in the fourth embodiment;

FIG. 15 is a diagram showing the file structure of a subset suppliedfrom the layer 4 in the fourth embodiment;

FIG. 16 is a block construction diagram showing the layer 5 and theapplication process in the sixth embodiment;

FIG. 17 is a block construction diagram showing the layer 5 and theapplication process in the seventh embodiment;

FIG. 18 is a block construction diagram showing the layer 5 and theapplication process in the eighth embodiment;

FIG. 19 is a block construction diagram showing the layer 5 and theapplication process in the tenth embodiment;

FIG. 20 is a flowchart for illustrating the operation of the reproducingprocess in the tenth embodiment;

FIG. 21 is a block construction diagram showing the layer 5 and theapplication process in the eleventh embodiment;

FIG. 22 is a flowchart for illustrating the operation of the reproducingprocess in the eleventh embodiment;

FIG. 23 is a diagram showing the file structure of a subset suppliedfrom the layer 4 in the eleventh embodiment;

FIG. 24 is a diagram showing a twelfth embodiment of the presentinvention;

FIG. 25A is a diagram showing items of information which are displayedby the error information display section incorporated in the scanningsection shown in FIG. 24; and

FIG. 25B is a diagram showing items of information which are displayedby the error information display section incorporated in thedata-reproducing section shown in FIG. 24.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Before describing an embodiment of this invention, the code pattern of adot code described in detail in International Application No.PCT/JP93/01377 (International Application KOKAI Publication No. WO94/08314) is corresponding to U.S. Pat. No. 5,896,403 first explained.

As shown in FIGS. 1A and 1B, a dot code 10 is constructed by arranging aplurality of blocks 12 each of which is constructed by a plurality ofdots arranged according to the content of data. That is, the blocks 12which are treated as data for every given unit are collectivelyarranged. Each of the blocks 12 is constructed by a marker 14, blockaddresses 16, address error detection data 18, and a data area 20 intowhich actual data is set.

The blocks 12 constructing the dot code 10 are arranged in atwo-dimensional form and the block addresses 16 are added to each of theblocks. An address for the X and Y addresses is attached to the blockaddress 16. For example, in FIG. 1A, the X and Y addresses of a blocklying in the uppermost and leftmost position are set to (1, 1). Theblock address of a block lying on the right side of the above block isset to (2, 1). In the same manner, a block address obtained byincrementing the X address for a block lying in the farther position inthe right direction and incrementing the Y address for a block lying inthe farther position in the downward direction is attached to the block,and thus the block address 16 is attached to each of the blocks 12.

Markers lying in the downmost position and markers lying in therightmost position are treated as dummy markers 22. That is, the block12 for one of the markers 14 is data in an area surrounded by fourmarkers 14 containing the above marker and lying in the lower rightposition with respect to the above marker, and the markers in thelowermost position and rightmost position are auxiliary markers arrangedto define the blocks lying in the second positions from the lowermostand rightmost positions, that is, dummy markers 22.

Next, the content of the block 12 is explained. As shown in FIG. 1B, ablock address 16 and error detection data 18 of the block address areattached between the marker 14 of the block 12 and a lower markerthereof. Likewise, a block address 16 and error detection data 18 of theblock address are attached between the marker 14 of the block 12 and amarker on the right side thereof. Thus, the block addresses 16 arearranged on the left side and upper side of the data area 20 and themarker 14 is arranged on the upper left corner of the data area. In thiscase, an example in which the block addresses 16 are recorded on twoportions of one block is shown, but it is possible to record the blockaddress in one portion. However, if the block addresses are recorded ontwo portions, the block address can be reliably detected by detectingone of the two block addresses even if noise is superposed on the otherblock address and an error occurs, and therefore, it is preferable torecord the block addresses in two portions.

By using the above-described two-dimensional block division system, theadvantages that it can easily attain the enlargement, reduction, anddeformation and cope with unintentional movement of hands can beattained since normalization is effected by detecting four adjacentmarkers and equally dividing a marker-to-marker portion by the number ofdots on the information reproducing device side.

The each of data dots 24 in the data area 20 has the dot size of severalten μm, for example. The size of the data dot may be reduced to severalμm depending on applications or purposes of usage, but in general, thesize is set to 40 μm, 20 μm or 80 μm. For example, the data area 20 hasthe size of 64×64 dots. The sizes can be freely enlarged or reduced in arange in which an error caused by the equal division can be neglected.The marker 14 has a function of position index and is set to have thesize which modulated data does not have, and may be formed in a circularform with the size of seven or more dots of the data dots 24, forexample, or formed as a black circular mark with the size of approx. 7×7dots. The block address 16 and error detection data 18 are constructedby the same dots as the data dots 24.

Next, an explanation is made for an example of hierarchical segmentationof information transfer protocol in a multimedia paper (MMP) system forrecording or reproducing multimedia information in the form of dotpattern code as one example of an optically readable code pattern on orfrom an information recording medium such as paper as is described indetail in Jpn. Pat. Appln. No. 6-121368 (International Application No.PCT/JP95/01050) by corresponding to U.S. Pat. No. 5,898,709 theinventors of this invention. In this case, the layer N (N=1 to 5)protocol is an operational rule for realizing a function necessary forthe layer N to comply with a request from the adjacent layer.

As shown in FIG. 2, the hierarchical segmentation includes a pluralityof logical hierarchical structures of the layers 1 to 5 on both of therecording and reproducing sides.

On the recording side, so-called multimedia information, caused in anapplication process X, generally, an application program on thecomputer, containing audio information such as voices and music, videoinformation derived from a camera or video device, and digital code dataobtained from a personal computer or word processor is transferred to anMMP recording device 26 used as an information recording device via theapplication layer (layer 5) and presentation layer (layer 4) constructedon the computer. In the MMP recording device, received data is printedor recorded on an information recording medium (transmission medium) 30such as paper as an optically readable dot code pattern by the data linklayer (layer 3), block data layer (layer 2) and physical layer (layer1).

The information recording medium (transmission medium) 30 is handed overto the reproducing side. Alternatively, the code pattern recorded on themedium 30 can be sent to the reproducing side by facsimile and printedor recorded on the information recording medium 30 such as paper on thereproducing side.

In the MMP reproducing device 28, the code pattern recorded on theinformation recording medium 30 is photographed, the data editingprocess is effected according to the restoring processing procedure fromthe layer 1 to the layer 3 or to the layer 5 in the reverse order of theorder at the recording time, and resultant data is given to thereproducing side computer. In the reproducing side computer, reproducedmultimedia information is given to the application process (applicationprogram) Y via the processing function of the layers 4 and 5, ifnecessary, in the reverse order of the order on the recording side.

Next, each layer (hierarchy) of the reproducing side is explained indetail, and since the layers of the recording side are just opposite tothose of the reproducing side, the explanation therefor is omitted.

FIG. 3A and FIG. 3B are diagrams showing an example of the procedure ofa process effected over multiple stages by use of a plurality ofhierarchical structures on the reproducing side. In the drawing,N-SDU_(n) indicates the Nth layer service data unit No. n, N-PDU_(n)indicates the Nth layer protocol data unit No. n, N-PCI_(n) indicatesthe Nth layer protocol control information No. n (corresponding tovarious processing information in this invention), N-UD_(n) indicatesthe Nth layer user data No. n, ADU indicates the application data unit,and ACH indicates the application control header (n=1 indicates data,n=2 indicates status information, and n=3 indicates controlinformation).

First, the layer 1 (physical layer) plays a basic role of ensuringreliably transmission of quantization data of a dot image. The layer 1defines electrical/physical conditions and various conditions forquantization (that is, simple transfer rule of the dot pattern,equalization system, quantization system and the like). The intra-layerfunction required for the layer 1, that is, the service providedtherefor includes provision of a plurality of transmission media (papertypes), permission of plural dot density, provision of a plurality ofscanner resolutions, provision of a plurality of transmission means forvideo signals, and provision of reading starting/ending function, and itmay further include representation of a plurality of gradations (binaryvalue, multiple values) of dots, and permission of multiplexedrepresentation of dots (color image photographing, transmission) asrequired.

The layer 1, that is, the physical layer has a functional module(photographing-system module 32) of optically photographing or pickingup a dot code pattern recorded on the information recording medium(transmission medium) 30 such as paper and outputting an image signal,and a functional module (reproduction equalizing module 34, quantizationmodule 36) of subjecting an image signal to the pre-processing (gaincontrol, equalization processing) and then sampling/quantizing thesignal. Further, it has a functional module of converting the quantizedvalue into digital data to create image data, a functional module offorming image data into a structure form to convert the data into agiven data format constructed by structure information (header, that is,first processing information) and data (substance of image data) andoutputting the same to an adjacent upper layer, that is, the layer 2, afunctional module of inputting/outputting status information and controlinformation relating to the process and the like.

Structured (image) data of photographing frame unit is given from thelayer 1 to the upper layer 2 as a service data unit (1-SDU₁).

The layer 2 (block data layer) plays a basic role of reliablytransmitting a block and a bit string in the block (in-block bitstring). The layer 2 defines various conditions (that is, blockdetection system, channel bit detection system, codingmodulation/demodulation system, and the like) for block transmission.The intra-layer function required for the layer 2, that is, the serviceprovided therefor includes block extraction and detection of dotsampling points, provision of a plurality of recording systems(provision of binary value, multiple values, multiplexed system and thelike), provision of a plurality of block patterns, provision of aplurality of coding modulation/demodulation systems, detection of therelative position of the block, information of block detection error,obstruction overcoming operations and the like. In this case, provisionof a plurality of block patterns includes a block size detectionfunction, marker definition/detection function, adaptation of thereadout order of various dots and the like.

The layer 2, that is, the block data layer includes a functional moduleof receiving structured (image) data (1-SDU₁) input from the adjacentlower layer, that is, the layer 1 as 2-PDU₁, recognizing and dividingthe structure information (2-PDI₁, that is, first processinginformation) and data substance (2-UD₁), and converting the datasubstance into a suitable form for the process, a functional module(block-unit dot detection point extraction (marker detection, patternmatching and the like) module 38, dot detection(identification/determination module 40) of processing the datasubstance converted into the suitable form for the processing andextracting a plurality of blocks formed in a block form for every giveninformation code unit, and a functional module (block ID datareproducing module 42, in-block data reproducing module 44) ofprocessing the extracted block and reproducing the information code ofblock unit. In this case, the information code of block unit containsdata substance, coding modulation information and structured informationfor linking a plurality of blocks. Further, the layer 2 has a functionalmodule (coding demodulation module 46) of reading the coding modulationinformation from the information of block unit and demodulating the datasubstance according to the coding modulation information, a functionalmodule of outputting structured data (block header, that is, secondprocessing information) of the demodulated block-form information codeand data substance (user data) to the adjacent upper layer, that is, thelayer 3 as 2-SDU₁, a functional module of inputting/outputting controlinformation and status information relating to the processing, and thelike.

That is, in the layer 2, a block unit dot detection point or marker isdetected from image data for every block data which is the first givenunit, and data dots are detected for every block unit according to thedetected marker to restore data of bit string. The detail of theprocessing is described in International Application No. PCT/JP93/01377(International Application KOKAI Publication No. WO 94/08314)corresponding to U.S. Pat. No. 5,896,403. For data of the block unit, aheader or block ID data is reproduced, then in-block data is reproducedas user data, demodulation for coding is effected and the data is givento the upper layer, that is, the layer 3 as data of block data unit.

The layer 3 (data link layer) plays a basic role of creating a givendata mass (subset element (fourth given unit)) which is ensured to havea preset error quality and ensuring reliably transmission. The layer 3defines conditions for linking block data (first given unit) and variousconditions (that is, interleave system/structure) for creatingmacro-blocks (third given unit)/supermacro-blocks (second given unit),(super) macro-block header and user data error control (that is, ECCsystem/structure) and the like. The intra-layer function required forthe layer 3, that is, the service provided therefor includes provisionof a function of restoring an abnormal condition of block addressreading/writing, determination of a reading state of a desired block(checking of a block of valid reading), setting of block arrangementstructure, creation of intermediate data masses, provision of aplurality of interleave systems/ranges/structures, provision of aplurality of ECC systems/ranges/structures, and the like.

The layer 3, that is, the data link layer has a functional module (blocklink (macro-block creation) module 48) of receiving a block-formationinformation code (2-SDU₁) input from the adjacent lower layer, that is,the layer 2 as 3-PDU₁, recognizing and reading structured information(3-PCI₁, that is, second processing information) from the input code,and linking a plurality of data substances (3-UD₁) of block unitaccording to the structured information to create (construct) amacro-block or supermacro-block. That is, it receives bit data stringsin the block unit from the layer 2, recognizes and divides a blockheader as 3-PCI₁ (second processing information) of a given number ofbits from the head of each block and a user data as 3-UD₁, and linkingblocks according to information described in the block header to createa macro-block. The thus created macro-block is constructed by attachedinformation (macro-block header, that is, one of second processinginformation) dispersedly arranged in the block and data substance (userdata).

Further, the layer 3 has a module (macro-block header unitde-interleave/error correction module 50) of reading the interleaveinformation from the macro-block header, de-interleaving the user dataof the macro-block according to the interleave information, reading theerror correction information from the macro-block header, and performingthe error correction process to the de-interleaved user data accordingto the error correction information, a functional block (macro-blocklink (supermacro-block creation) module 52) of reading structuredinformation for creating (constructing) a supermacro-block from themacro-block header, and linking a plurality of macro-blocks according tothe structured information to create (construct) a supermacro-block, afunctional module (supermacro-block unit de-interleave module 54) ofreading interleave information from the macro-block header andde-interleaving user data of the supermacro-block according to theinterleave information, a functional module (supermacro-block unit errorcorrection module 56) of reading error correction information from themacro-block header and correcting the error of the user data subjectedto the de-interleaving process according to the error correctioninformation, a functional module (subset element unit output processingmodule 58) of reading structure specifying information of a subsetelement, that is, subset element header from the macro-block header andseparating the subset element from the user data of the supermacro-blockafter the error correction according to the subset element header, afunctional module of outputting the separated subset element unit to theadjacent upper layer, that is, the layer 4 as 3-SDU₁, and a functionalmodule of inputting/outputting status information and controlinformation relating to the process.

That is, the layer 3 has a multi-stage function of first linking orcoupling the blocks to create a macro-block and then linking themacro-block to a supermacro-block. Then, after the error correctionprocess, it reads the subset structure specification (third processinginformation) described in the macro-block header, separates thesupermacro-block into data corresponding to the concept of subsetelements, and outputs the subset elements. That is, data is given to theupper layer as 3-SDU₁ in the unit of subset element.

The layer 4 (presentation layer) plays a basic role of ensuring creationof a subset. The layer 4 defines various conditions for linking subsetelements to create a subset. The intra-layer function required for thelayer 4, that is, the service provided therefor includes selection ofsubset elements necessary for an object file, creation of the subset anddetermination of the condition therefor, and adaptable data conversionfor DOS or the like. The subset indicates recognizable information unitdata. That is, the macro-block and supermacro-block contain multimediainformation such as sound and picture and each of data masses obtainedby dividing the above block into data masses each of which is limited toinformation relating only to sound or information relating only topicture so as to be recognized as one type of information unit is calleda subset.

The layer 4, that is, the presentation layer has a functional module(subset element link information reading module 60) of receiving data(3-SDU₁) of subset element unit input from the adjacent lower layer,that is, the layer 3 as 4-PDU₁ and reading structured information(4-PCI₁, that is, fourth processing information) from the received data,and a functional module (subset element link (subset creation) module62) of linking data substances of subset element unit according to theread structured information to create (construct) a subset. Data ofsubset element unit is constructed by structured information (subsetelement header) for linking subset elements to create (construct) asubset and user data substance.

Further, the layer 4 has a functional module of reading attachedinformation necessary for an existing or new interface with the adjacentupper layer from the created subset and attaining the interfacematching, a functional module of outputting part of the subset or theentire attached information and data substance as 4-SDU₁ to the adjacentupper layer, that is, the layer 5, and a functional module ofinputting/outputting control information and status information relatingto the process.

The layer 5 (application layer) plays a basic role of unfailinglyensuring that the file management can be carried out in good condition.The layer 5 defines various conditions (that is, file creating conditionand the like) for effecting the file management. The intra-layerfunction required for the layer 5, that is, the service providedtherefor includes provision of the read/write process of a subset orfile of application request.

The layer 5, that is, the application layer has a functional module(file management system module 64) of receiving subset data (4-SDU₁)input from the adjacent lower layer, that is, the layer 4 as 5-PDU₁,reading file management information from the attached information(5-PCI₁, that is, fifth processing information) or data substance(5-UD₁), effecting the file management according to the file managementinformation, and reading data in the unit of subset or in the unit offile after linking subsets to create a file, a functional module ofoutputting data unit of the file unit or subset unit created based onthe file management as 5-SDU₁ to the application process, and afunctional module of inputting/outputting control information and statusinformation relating to the process.

The application process plays a basic role of realizing the applicationusing the MMP system. The application process includes the source sampledata shuffling system/structure, scramble system/structure forciphering, and data compression system/structure, data structure ofsound, text or image and the like. The function required for theapplication process, that is, the service provided therefor includesprovision of source sample data shuffling system, provision of scramblesystem and the like, and it may further include provision of a pluralityof data compression systems and compression/expansion operations,determination of information types, selection of data structure and thelike, if required.

Now, one embodiment of this invention is explained with reference to theaccompanying drawings. This invention relates to the detail of the layer5 (application layer) and the application process layer in the case ofstand-alone type for realizing the hierarchical structure described inJpn. Pat. Appln. No. 6-121368 (International Application No.PCT/JP95/01050) corresponding to U.S. Pat. No. 5,898,709.

First Embodiment

FIG. 4 is a diagram showing the structure of the first embodiment.

A microcomputer or controller 66 constructs a set specificationidentifier determining section 68 and an error processing section 70,and it receives a subset from the layer 4, that is, it receives 4-SDU₁as 5-PDU₁, receives 4-SDU₂ which is a status signal as 5-PCI₂, andreceives 4-SDU₃ which is a parameter setting signal as 5-PCI₃. The setspecification identifier determining section 68 determines whether thereadout code information is a dot code 10 or not, whether it matcheswith the specification or not, and whether it can be reproduced by useof the hardware or not based on 5-PCI₂ and 5-PCI₁ among 5-PDU₁, and ifthe result of determination is "NO", it causes the error processingsection 70 to effect the error processing operation and causes the errorinformation display section 72 to display the error state. Further, theset specification identifier determining section 68 effects processes ofsetting parameters for reproduction, setting selection of the decoder ofthe decoding section 74, and selection of the reproducing output section76 and the like. Further, it outputs a data request, data address andthe like to the layer 4.

The decoding section 74 receives and decodes 5-UD₁ among 5-PDU₁ andincludes an audio decoder 74A for decoding audio information and animage decoder 74B for decoding image information. Text information isoutput as it is. That is, since a subset or data obtained in the form ofdata mass which is limited to information relating only to sound,information relating only to image or information relating only to textso as to be recognized as one information unit is input from the layer4, an adequate decoding process corresponding to the information iseffected. For example, in the case of audio information, if data iscompressed in the compression system of CELP system in which theinformation is specified to human languages, a corresponding decodingprocess is effected in the audio decoder 74A. Further, in the case ofimage information, if data is compressed in the compression system ofJPEG system, a corresponding expanding process is effected in the imagedecoder 74B. The decoders 74A and 74B are selectively operated by adecoder selection signal from the set specification identifierdetermining section 68.

The reproducing output section 76 receives a decoded output from thedecoder section 74 and converts the same into a signal suitable for theoutput device and includes an audio reproducing output section 76A,image reproducing output section 76B and text reproducing output section76C. The reproducing output sections 76A, 76B, 76C are selectivelyoperated by a reproducing output circuit selection signal from the setspecification identifier determining section 68, and in this case, sincethe audio reproducing output section 76A is designed to cope with pluraltypes of clocks and filters, for example, the clock and filter for thesampling frequency of 7 kHz or 8 kHz, or the clock and filter for thesampling frequency of 48 kHz of CD quality, the clock and filter canalso be selected by the reproducing output circuit selection signal.Likewise, in the case of image information, the image reproducing outputsection 76B converts the image size into 640×480 dots, for example,according to the reproducing output circuit selection signal. Further,in the case of text information, the text reproducing output section 76Cconverts text information into characters.

Then, an output signal of the audio reproducing output section 76A isoutput as a voice from an audio output device 78 such as a speaker,earphone or headphone. Further, output signals from the imagereproducing output section 76B and text reproducing output section 76Care displayed on a display output device 80 such as a monitor.

When some error has occurred, the error processing section 70 informsoccurrence of error to the user by lighting an alarm lamp of LED,displaying markers or characters by LCD, lighting a red or yellow lampon the error information display section 72, or generating beep sound orgiving warning by voice according to the type of the error.

Now, data input from the layer 4 is explained with reference to FIG. 5.

Basically, data is transferred from the layer 4 in the form of subset,and a file header area 84 is exceptionally attached in the front portionof the top subset header area 82₁ which is first arranged in the subset.In the drawing, three subsets are successively shown to simultaneouslyindicate cases of audio, image and text information, but in practice,data is transferred for each subset.

In the file header area 84, a next subset data control header (SDCH)pointer 84A, set specification name identifier 84B and information 84Cindicating the presence/absence of SDCH are inserted. A user data format(UDF) 86 indicating that the header is a file header is set in front ofthe file header area 84.

The next SDCH pointer 84A takes an area of four bytes and designates ahead address of the next SDCH. The set specification name identifier 84Bincludes a file specification name (for example, "m, p, 1") 84B₁ ofthree bytes, file specification version 84B₂ of three bytes, and setspecification name and set specification version 84B₃ and 84B₄ of eightbytes in total. The set specification name 84B₃ indicates thespecification name to make it unnecessary to refer to each SDCH in acase where the specification value of each SDCH is determined by theindividual specification. Further, the presence/absence-of-SDCHindicating information 84C indicates the presence or absence of SDCH.

Further, in the subset header areas 82₁, 82₂ and 82₃, differentinformation items corresponding to the types of data items inserted intothe data areas 88₁, 88₂ and 88₃ of the corresponding subset areinserted.

For example, the subset area 82₁ indicates a case wherein audio data isinserted into the data area 88₁, and the subset data control header(SDCH) 82₁₁ is constructed by a user data format (UDF) 82₁₁ a, next SDCHpointer 82₁₁ b, parameter 82₁₁ c, and data area starting and endingaddresses 82₁₁ d, 82₁₁ e.

The UDF 82₁₁ a indicates the type of data inserted into thecorresponding data area 88₁, and in this case, information of "audio" isinserted.

In the next SDCH pointer 82₁₁ b, the head address of SDCH of the nextsubset header is inserted. In this case, the absence of a next subset isindicated by inserting a value, for example, "FF_(H) (_(H) indicates ahexadecimal number)" or "00_(H) " which the content of the next SDCHpointer cannot take as an address.

In this case, in the parameter 82₁₁ c, a parameter for audio isinserted, and the following information items are inserted, for example.

A_(d0) : audio data is present (1: present);

A_(d1) : stereo (1: stereo);

A_(d2) : R/L order (1: R, 0: L);

A_(d3) to A_(d7) : reservation;

A_(d8) to A_(d15) : compression system;

A_(d16) to A_(d23) : quantization bit number;

A_(d24) to A_(d31) : sampling frequency;

A_(d32) to A_(d39) : reservation;

A_(d40) to A_(d71) : data size (four bytes).

In this case, information of "audio data is present" indicates whetheraudio information is present or not, and information of "stereo"indicates whether data is stereo or not. Information of "R/L order"indicates whether the arrangement of data is "right, left" or "left,right" in the case of stereo. Information of "reservation" indicates anavailable area to be used later when an additional parameter isprovided. Information of "compression system" specifies the compressionsystem such as CELP system, and information of "quantization bit number"indicates that the quantization bit number is 8 bits, 16 bits or 14bits, for example. Information of "sampling frequency" indicates thatthe sampling frequency is 8 kHz, 16 kHz, 32 kHz or 48 kHz, andinformation of "data size" indicates the amount of total data in thedata area 88₁.

In the data area starting and ending addresses 88₁₁ d and 88₁₁ e, thehead address and end address of the corresponding data area 88₁ areinserted.

Likewise, the subset header area 82₂ indicates a case wherein image datais inserted into the data area 88₂, and the SDCH 82₂₁ is constructed bya UDF 82₂₁ a, next SDCH pointer 82₂₁ b, parameter 82₂₁ c, and data areastarting and ending addresses 82₂₁ d, 82₂₁ e. In this case, as theparameter 82₂₁ c, the following information items are inserted, forexample.

V_(d0) : image data is present (1: present);

V_(d1) to V_(d0) : color system;

V_(d4) : γ characteristic (1: 0.45, 0: 1);

V_(d5) to V_(d7) : reservation;

V_(d8) to V_(d15) : compression system;

V_(d16) to V_(d23) : quantization bit number;

V_(d24) to Vd₃₉ : horizontal pixel number;

Vd_(d40) to V_(d55) : vertical pixel number;

V_(d56) to V_(d63) : reservation;

V_(d64) to V_(d95) : data size.

In this case, information of "color system" indicates whether image datais a color image or black and white image, and if it is a color image,the information also indicates whether the image data is based on RGB,or on cyan, magenta and color difference component. Information of "γcharacteristic" indicates whether the γ characteristic is 1 or 0.45,information of "compression system" indicates the compression systemsuch as JPEG system. Information of "quantization bit number" indicates8 bits, 6 bits or 10 bits or more which is more precise. Further,information items of "horizontal pixel number" and "vertical pixelnumber" define the size of an image plane used for forming a2-dimensional image. For example, it indicates whether the image is aso-called VGA image of 640×480 dots or a high-resolution image such as aso-called SVGA image of 1260×1090 dots.

Likewise, the subset header area 82₃ indicates a case wherein text datais inserted into the data area 88₃, and the SDCH 82₃₁ is constructed bya UDF 82₃₁ a, next SDCH pointer 82₃₁ b, parameter 82₃₁ c, and data areastarting and ending addresses 82₃₁ d, 82₃₁ e. In this case, as theparameter 82₃₁ c, the following information items are inserted, forexample.

T_(d0) : text data is present (1: present);

T_(d1) : application header is present;

T_(d2) to T_(d7) : reservation;

T_(d8) to T_(d15) : compression system;

T_(d16) to T_(d23) : format;

T_(d24) to T_(d39) : horizontal character number;

T_(d40) to T_(d55) : vertical character number;

T_(d56) to T_(d63) : reservation;

T_(d64) to T_(d95) : data size.

The explanation for the "compression system" in the decoding section 74in FIG. 4 is made based on the assumption that text data is notcompressed, but it becomes necessary to compress the data when theamount of data becomes large, and the compression system used in such acase is described here.

Data items in the file header area 84 and subset header areas 82₁, 82₂,82₃ are supplied to the set specification identifier determining section68 as 5-PCI₁ and data items in the data areas 88₁, 88₂, 88₃ are input tothe decoding section 74.

FIG. 6 is a flowchart of the reproducing process with the constructionof FIG. 4.

First, the set specification identifier determining section 68 reads5-PCI₂ which is a status signal (step 11) and checks whether a subset iscompleted or not (step S12). Since data is transferred from the layer 4to the layer 5 when the data for one subset unit is obtained and astatus signal indicating that the data for one subset unit is obtainedor the subset can be output is supplied as 5-PCI₂, it becomes possibleto determine whether the subset is completed or not according to thesignal. If the subset is not yet completed, the step S11 is effectedagain.

If the subset is completed, whether the presence or absence of error ischecked according to error information contained in the status signal of5-PCI₂ (step S13). That is, whether or not an error is generated in theprocess effected up to the layer 4, that is, whether or not block datahas been read as a code or whether or not the error correction has beencompletely effected in the error correcting process can be determined.

If the error information is not good, that is, if the error is present,an error flag E is set to "1" (step S14) and then the error process aswill be described later is effected (step S15). That is, the errorprocessing section 70 effects the error display corresponding to thetype of error by lighting an alarm lamp of LED, displaying markers orcharacters by LCD, lighting a red or yellow lamp on the errorinformation display section 72, or generating beep sound or givingwarning by voice, for example.

If no error is present, the set specification identifier determiningsection 68 effects the process of determining the set specification nameidentifier 84B of the file header area 84 among 5-PCI₁ (step S16).Whether it is a reproducible code or not is determined according to theset specification name identifier 84B. The process is explained indetail later.

Next, the decode mode and reproducing parameter setting process which isdescribed later in detail is effected (step S17). That is, a decoderselection signal, reproducing output circuit selection signal andparameters such as a clock and filter necessary for the reproducingprocess are extracted and set according to 5-PCI₁. The decoder selectionsignal is input to the decode section 74, the reproducing output circuitselection signal and parameters are input to the reproducing outputsection 76, and various parameters are set and selected.

After this, data in the data area of 5-PDU₁, that is, actual data issubjected to the decoding process in the decoder selected in thedecoding section 74 (step S18) and reproduced and output to thecorresponding output devices 78, 89 by means of the selected reproducingoutput section 76 (step S19).

That is, if it is determined by UDF that data is audio data, the audiodecoder 74A is selected by the decoder selection signal and the inputdata is subjected to the decoding process by the audio decoder 74A.Then, the audio data is passed through the audio output section 76Aselected by the reproducing output circuit selection signal andcorresponding to the voice having parameters set therein and reproducedand output from the audio output device 78 such as a speaker orearphone.

Likewise, if it is determined by UDF that data is image data, the datais supplied via the image decoder 74B and image reproducing outputsection 76B and displayed on the display output device 80 such as amonitor, and if it is determined that data is text data, the data issupplied via the decoding section 74 as it is, converted into charactersby the text reproducing output section 76C and displayed on the displayoutput device 80.

FIG. 7 is a flowchart for illustrating the set specification nameidentifier determining process in the step S16 in detail.

First, the counter S is initialized to "4" and the counter k isinitialized to "0" (step S21). The reason why the counter S is set to"4" is that the next SDCH pointer 84A of the file header area 84 is setto four bytes as described before, and if it is set to six bytes, thecounter S is set to "6". The counter k simply functions as a loopcounter, and therefore, a value "0" is set as an initial value.

Next, a value (A+S) is set into an address counter a and a value (i+k)is set into a counter i (step S22). In this case, A indicates a headaddress of the file header area 84, and therefore, if the value of thecounter S, in this example, "4" is added to the value of A, the contentof the address counter a indicates the head address of the setspecification name identifier 84B. Further, the content of the counter iindicates an address of a memory (not shown) of the set specificationidentifier determining section 68. That is, the memory stores patternsMi (i=0 to n) of the set specification name identifier and the value ofthe address counter i indicates one byte of the pattern Mi.

The pattern Mi is constructed as "m, p, 1, 1, 0, 0, 0, L, Y, S, 1, 1, 0,0", for example. That is, the first three bytes "m, p, 1" correspond tothe file specification name 84B₁ of the set specification nameidentifier 84B, the next three bytes "1, 0, 0" correspond to the filespecification version 84B₂ of the same, and the following bytes "O. L,Y, S, 1, 1, 0, 0" correspond to the set specification name and setspecification version 84B₃ and 84B₄ of 8 bytes. That is, this exampleindicates "mp1 version 1.00, OLYS1 version 1.00". As described before,the set specification name 84B₃ indicates the specification name so asto omit the necessity of referring to each SDCH if the specificationvalue of each SDCH is determined by the individual specification. Forexample, the sound source, compression system and sampling rate aredetermined by "S1".

Of course, a plurality of patterns Mi are prepared and, for example, ifthe set specification name 84B₃ is "V1", the audio source, compressionsystem and sampling rate are determined, if it is "I1", the imagesource, compression system and display size are determined, and if it is"T1", the text source and file form are determined.

After the values of the respective counters are set as described above,whether or not the pattern Ma (bytes indicated by the address a) of theset specification name identifier 84B coincides with the pattern Mi(bytes indicated by i) stored in the memory (not shown) is determined(step S23), if the former pattern coincides with the latter pattern,whether the value of the counter k has reached n or not is determined(step S24), if it is determined that it has not reached n, the values ofthe counters S and k are incremented by "1" (step S25), and the processreturns to the step S22 to compare the next byte data. Then, ifcomparison for all of the bytes is completed, that is, if it isdetermined in the step S24 that the value of the counter k has reachedn, the determining process is terminated and the next decode mode andreproducing parameter setting process is effected.

On the other hand, if it is determined in the step S23 that the formerpattern does not coincide with the latter pattern, "2" is set into theerror flag E (step S26) and then the error process in the step S27 iseffected.

Next, the error process effected in the steps S15 and S27 is explainedwith reference to the flowchart shown in FIG. 8.

The error processing section 70 first determines whether the error flagE set by the set specification identifier determining section 68 is "2"or not (step S31). In the error process in the step S15, since the errorflag E is set at "1", scanning error and instruction of re-scanning aredisplayed (step S32). For example, when the scanning section foreffecting the process in the layer 1 and the restoring section foreffecting the processes of the other layers are constructed in differentcasings, the error information display section 72 is constructed tocontain error information display sections mounted on the respectivecasings. Therefore, display in the case where the error flag E is set at"1" is attained by an error display information section mounted on thescanning section (not shown).

On the other hand, if the error flag E is set at "2", that is, in thecase of error processing in the step S27, whether the value of thecounter S is less than "9", that is, whether non-coincident byte isdetected during the comparison of a portion of the file form name andfile version of "m, p, 1, 1, 0, 0" which is the front half of thepattern Mi is determined (step S33).

If the value of the counter S is less than "9", two processing routinesare prepared. That is, the first processing routine is used when thehardware side is not an applicable type, and in this case, thefile-off-specification code is displayed (step S34).

The second processing routine is used in the case of applicable type,that is, when the hardware is applicable even if the code isoff-specification, and in this case, it is recognized that the code is anon-registered code of MMP specification, and a corresponding processingroutine is effected to reproduce and output data in the same manner asdescribed before (step S35). That is, even if the error flag E is set at"2", it is determined that no error has occurred and a next step iseffected when the hardware is an applicable type, but the error isdisplayed when the hardware is not an applicable type.

On the other hand, if the value of the counter S is larger than "9", anerror state is displayed in which the file specification is satisfied,that is, the specification is a correct MMP specification, but soundcannot be reproduced by the hardware by chance, for example, or imagedata, that is, a source which cannot be applied is given in the case ofhardware exclusively used for audio reproduction. Therefore, in theabove case, display of non-reproducible state corresponding to the errorstate is effected (step S36).

The error display in the above steps S32, S34, S36 is attained, forexample, by lighting an alarm lamp of LED, displaying markers orcharacters by LCD, lighting a red or yellow lamp on the errorinformation display section 72, or generating beep sound or givingwarning by voice according to the type of the error, but it is possibleto inform the type of error to the user by displaying the contents ofthe scanning error display, re-scanning instruction display,off-specification code display and non-reproducible display in differentmanners, for example, by lighting the red lamp for the scanning error,lighting the yellow lamp for the off-specification code.

Next, the decode mode and reproducing parameter setting process in thestep S17 is explained with is reference to the flowchart of FIG. 9.

First, the set specification identifier determining section 68 sets thevalue of the next SDCH pointer 84A of the file header area 84 into theaddress counter a (step S41), reads UDF lying in the address, forexample, UDF 82₁₁ a of the subset header area 82₁, determines the media,for example, voice, outputs a decoder selection signal to the decodingsection 74 so as to select the audio decoder 74A, and outputs areproducing output circuit selection signal to the reproducing outputsection 76 so as to select the audio reproducing output section 76A(step S42). Then, it reads the content of the next SDCH pointer 82₁₁ bof the next address (in this case, "FF_(H) " indicating that no SDCH ispresent is set) (step S43).

After this, the content of SDCH, that is, the parameter 82₁₁ c is read(step S44) and the parameter is set (step S45). That is, the parametersetting is effected by the reproducing output circuit selection signal.Then, whether the reading of SDCH data, that is, parameter 82₁₁ c iscompleted or not is determined (step S46), and if it is not yetcompleted, the step S44 is effected again and the process of reading thenext parameter is repeated. That is, since it is already determined thatdata is audio data by the UDF 82₁₁ a and the address range of theparameter 82₁₁ c is determined by the specification in the case of audiodata, whether the reading of the parameter is completed or not can bedetermined by determining the address.

Then, when all of the parameters are set, the data area starting address82₁₁ d and data area ending address 82₁₁ e for the corresponding dataarea 88₁ a are read and stored into a memory (not shown) (step S47).

Second Embodiment

FIGS. 10 and 11 are diagrams showing the construction of the secondembodiment of this invention and the flowchart of the reproducingprocess and portions which are the same as those of FIGS. 4 and 6 aredenoted by the same reference numerals.

The construction of this embodiment is different from the constructionof the first embodiment in that the set specification identifierdetermining section 68 includes UDF, SDCH reading section 68A forreading the UDF and SDCH.

Further, the file structure in which a plurality of subsets aresuccessively arranged and a file header area 84 is arranged only infront of the first subset as shown in FIG. 5 is transferred from thelayer 4.

Therefore, in the reproducing process, the UDF, SDCH reading section 68Aof the set specification identifier determining section 68 does notterminate the process after one subset is reproduced and output in thestep S19, but determines whether the reproducing process for all of thesubsets is completed or not (step S51), and if it is not yet completed,the step S17 is effected again and the reproducing process for the nextsubset data is effected. That is, in the example shown in FIG. 5, audiodata is first reproduced, image data is next reproduced and then textdata is reproduced. In this case, whether the reproducing process forall of the subsets is completed or not is determined by checking thevalues of the next SDCH pointers 82₁₁ b, 82₂₁ b, 82₃₁ b and thedetermination is made according to whether it is an end code such as"FF_(H) " or not.

Third Embodiment

FIG. 12 is a diagram showing the file structure in the third embodimentof this invention and portions which are the same as those of FIG. 5 aredenoted by the same reference numerals.

In the file structure of FIG. 5, one subset header is attached to eachsubset, but since data starting addresses 82₁₁ d, 82₂₁ d, 82₃₁ d andending addresses 82₁₁ e, 82₂₁ e, 82₃₁ e are respectively provided in thesubset header areas 82₁, 82₂, 82₃ for corresponding data areas 84₁, 84₂,84₃, it is not necessary to successively arrange the header areas 82₁,82₂, 82₃ and the data areas 84₁, 84₂, 84₃, and it is possible tocollectively arrange the subset header areas 82₁, 82₂, 82₃ as shown inFIG. 12.

The flowchart for the reproducing process is the same as that of FIG. 11of the second embodiment. However, in this embodiment, the UDF, SDCHreading section 68A of the set specification identifier determiningsection 68 collectively reads the subset header areas 82₁, 82₂, 82₃ inthe set specification name identifier determining process of the stepS16. Then, in the decode mode, reproducing parameter setting process ofthe step S17, the process of selecting the decoder 74A, 74B andreproducing output section 76A, 76B, 76C and setting parameters iseffected.

Of course, the parameter setting process may be effected to collectivelyset the parameters at the first time. That is, as shown in FIG. 13, thevalue of the next SDCH pointer 84A of the file header area 84 is setinto the address counter a (step S41), UDF lying in the address is readand the content thereof is stored into a memory (not shown) (step S42),and then the content of the next SDCH pointer 82₁₁ b is read (step S43).After this, the content of the SDCH, that is, the parameter is read(step S44), and the parameter is set into a corresponding reproducingoutput section (step S45). Then, whether reading of SDCH data, that is,parameter is completed or not is determined (step S46), and if it is notyet completed, the step S44 is effected again and the process of readingthe next parameter is repeated. When setting of all of the parameters iscompleted, a data area starting address and data area ending address fora corresponding data area are read and stored into a memory (not shown)(step S47). Then, whether the reproducing process for all of the subsetsis completed or not is determined (step S48), and if it is not yetcompleted, the step S41 is effected again and the process of storing UDFof the subset and address and setting parameters is repeated.

In the third embodiment, the program for the controller 66 can besimplified.

Fourth Embodiment

FIG. 14 is a diagram showing the construction of the fourth embodimentof this invention and portions which are the same as those of FIG. 4 aredenoted by the same reference numerals.

The construction of this embodiment is different from the constructionof the first embodiment in that the set specification identifierdetermining section 68 includes a preset data group storing section 68Bfor mode and parameter groups in which stores a plurality of mode groupsand parameter groups.

In this embodiment, not only the process of determining the reproduciblecode but also the process of specifying the selection of the parameteris effected in the set specification name identifier determiningprocess. That is, modes or parameters specified by the result ofdetermination in the set specification name identifier 84B can becollectively selected from the mode group or parameter group previouslystored in the preset data group storing section 68B for the mode andparameter groups.

Therefore, in this embodiment, it becomes unnecessary to read all of theparameters one by one in the decode mode and reproducing parametersetting process in the step S17 and it becomes possible to skip the stepS17 and effect the process up to the decoding process of the step S18,thereby making it possible to reduce the reproducing time.

Further, since selection of the decoding section 74 and reproducingoutput section 76 and setting of parameters can be instantly attainedonly by use of the subset specification name identifier 84B of the fileheader area 84 without describing the UDF and reproducing parameters inthe subset header area in some cases, the size of the subset header areacan be reduced accordingly and the actual data area can be enlarged.That is, as shown in FIG. 15, the data area 88₄ can be arrangedimmediately after the file header area 84 with the subset header areaomitted. However, in this case, a starting address 84D and endingaddress 84E of the data area 88₄ are set in addition to the next SDCHpointer ("FF_(H) ") 84A and set specification name identifier 84B in thefile header area 84 (a reference numeral 84F denotes a space area).

Fifth Embodiment

Further, in a case where a plurality of subsets are provided, the fourthembodiment can be modified in the same manner as the manner in which thefirst embodiment is modified into the second embodiment.

However, in this case, the number of subsets is counted in the setspecification name identifier determining process of the step S16 ofFIG. 11, the number is counted down each time the reproducing outputprocess for one subset is terminated in the step S19, and when theprocess returns from the step S51 to the step S17, selection of thedecoding section 74 and reproducing output section 76 is effectedaccording to the counted value.

Therefore, the process of decoding actual data information of a nextsubset can be immediately started without reading header information ofthe next subset, and the process can be simplified and the processingtime can be reduced.

Sixth Embodiment

Next, the sixth embodiment of this invention is explained.

The first to fifth embodiments are examples in which multimediainformation including audio data, image data and text data is dealtwith, but this embodiment is a case of application in which only audioinformation among the above information is dealt with.

FIG. 16 is a diagram showing the construction thereof and is basicallythe same as the construction of FIG. 4. However, in this embodiment, thedecoding section 74 includes a plurality of audio decoders 74A₁, 74A₂,and the reproducing output section 76 includes a plurality of audioreproducing output sections 76A₁, 76A₂, 76A₃. That is, if theinformation is limited to audio information, a plurality of audiodecoders 74A₁, 74A₂ are provided since audio information includesmusical sounds and languages by voice and the compressing and expandingprocesses for them are provided. Further, in order to cope with this,the reproducing output section 76 is also subdivided according to thevoice, environmental sound, and stereo music and the parameters areprovided such that the clock and filter characteristic can be adequatelyselected. Further, in the audio output device 78, the speaker orearphone 78A and stereo speaker 78B can be adequately and selectivelyused according to the voice, environmental sound or stereo music.

The reproducing process is basically the same as that of the firstembodiment shown in FIG. 6. However, in the set specification nameidentifier determining process of the step S16, whether data is areproducible code or not is determined in the first embodiment, butattribute information of the source such as audio information and imageinformation is not determined. On the other hand, in this embodiment, inthe set specification name identifier determining process, attributeinformation of the source is also determined and whether data is anaudio code or not is determined, and if the data is an audio code, theprocess is permitted to proceed to the next step.

Seventh Embodiment

FIG. 17 is a diagram showing the construction of the seventh embodimentwhich is obtained by modifying the sixth embodiment in the same manneras that in which the first embodiment is modified into the secondembodiment.

That is, in this embodiment, in a case where a plurality of subsets ofthe same source type are provided or where a plurality of subsets ofdifferent source types such as languages and music are provided,reproduction is effected at any time until reproduction for all of thesubsets is completed.

Like the second embodiment, this embodiment has UDF, SDCH readingsection 68A as hardware and selects the reproduction. Further,completion of the reproducing process for all of the subsets isdetermined according to whether the next SDCH pointer is "FF_(H) " ornot.

Eighth Embodiment

FIG. 18 is a diagram showing the construction of the eighth embodimentwhich is obtained by modifying the sixth embodiment in the same manneras that in which the first embodiment is modified into the fourthembodiment.

That is, in the set specification identifier determining section 68, apreset data group storing section 68B for storing mode groups andparameter groups are prepared in a program ROM area or the like. Thatis, after the set specification name identifier determining process iseffected, all of the corresponding parameters are collectivelyrecognized by use of the set specification name identifier, immediatelyset, and then decoded, reproduced and output in an adequate form.

Like the fourth embodiment, in this embodiment, since it is unnecessaryto read all of the parameters contained in SDCH one by one, thereproducing time can be reduced accordingly and the high-speed processcan be attained.

Ninth Embodiment

The eight embodiment can be modified in the same manner as that in whichthe fourth embodiment is modified into the fifth embodiment.

Tenth Embodiment

FIG. 19 is a diagram showing the construction of the tenth embodiment.

In the sixth to ninth embodiments, the decoding sections and reproducingoutput processing sections are selected according to plural types ofcompression/expansion systems and sources, although they are exclusivelyused for audio reproduction, but this embodiment is an example of alow-cost device having a decoding section 74' specified for onecompression/expansion system and a reproducing output section 76'specified for one source. That is, if the device is used for Englishconversation, for example, the decoding section 74' is constructed inhardware to have a compression/expansion system such as DODCELP orLMCELP in which languages are characterized or a compression system suchas psi-CELP, and the reproducing output section 76' is constructed inhardware to have a clock rate and filter characteristic corresponding toa sampling rate since the human voice can be sufficiently reproduced bythe sampling rate of 8 kHz in the case of languages.

As shown in the flowchart of FIG. 20, in the reproducing process, theset specification identifier determining section 68 reads 5-PCI₂ (stepS11), and effects the determining process of the set specification nameidentifier 84B of the file header area 84 (step S16) if it is determinedthat necessary subsets are collected (step S12) and no error is detected(step S13). In this embodiment, the above process is effected bydetermining whether or not the set specification name identifier 84Bcoincides with an applicable set specification name identifier patternof this device.

Only when the set specification name identifier 84B coincides with theapplicable set specification name identifier pattern, the decodingsection 74' and reproducing output section 76' are permitted to effectthe decoding process (step S18) for actual data of the subset andreproducing output process (step S19) therefor.

Further, if no coincidence is detected, the error process is immediatelystarted and an error message indicating that reproduction cannot beeffected in this device is displayed on the error information displaysection 72.

In this embodiment, since it is unnecessary to provide a selectingsection, switching section, a plurality of decoders and a plurality ofreproducing output sections, the construction is made simple in hardwareand the cost can be lowered. Further, since the decoding and reproducingoutput processes can be immediately started by determining whether theset specification name identifier is coincident or not, the reproducingprocess can be effected at extremely high speed.

Eleventh Embodiment

FIG. 21 is a diagram showing the construction of the eleventhembodiment.

Like the tenth embodiment, this embodiment is an example of a deviceexclusively used for audio reproduction, but this device is notspecified to only one compression/expansion system and has a program RAM90 for storing a decoding process program, and a decoding section 92 foreffecting the actual decoding process according to the decoding processprogram so as to cope with various types of compression/expansionsystems. In this case, the program RAM 90 stores the decoding processprogram according to a decoding program data install signal from the setspecification identifier determining section 68. The decoding processprogram is transferred from the layer 4.

FIG. 22 is a flowchart for illustrating the operation of the reproducingprocess of this embodiment, and the set specification identifierdetermining section 68 first reads 5-PCI₂ which is a status signal (stepS11), determines whether necessary subsets are collected (step S12), anddetermines whether any error has occurred or not (step S13). If an errorhas occurred, the error flag E is set to "1" (step S14), and then theerror process is started (step S15). If no error has occurred, the setspecification identifier determining section 68 effects the process ofdetermining the set specification name identifier 84B of the file header84 among 5-PCI₁ (step S16).

After this, the decoding process program is installed into the programRAM 90 (step S61). In this embodiment, the file structure transferredfrom the layer 4 has a data area 88₅ for option data in addition to adata area 88₁ for audio data as a data area as shown in FIG. 23, and thedecoding process program is described in the option data area 88₅.Therefore, the set specification identifier determining section 68 readsSDCH in the subset header area of the option data area 88₅, outputs adecoding program data install signal to the program RAM 90 according tothe readout SDCH, and then installs data of the option data area 88₅into the program RAM 90.

SDCH 82₅₁ of the subset header area 82₅ for option data includes UDF82₅₁ a, next SDCH pointer 82₅₁ b, parameter 82₅₁ c, data area startingand ending addresses 82₅₁ d and 82₅₁ e. In this case, as the parameter82₅₁ c, the following information items are inserted, for example.

O_(d0) to O_(d39) : option specification name and version;

O_(d40) to O_(d47) : version-up/temporary measure/function adding code;

O_(d48) to O_(d70) : reservation;

O_(d71) : corresponding DSP, microcomputer code.

For example, if O_(d1) =1, it indicates a de-scrambling table andpassword, if O_(d2) =1, it indicates an SDSP program, if O_(d2) =0, itindicates a microcomputer program, and O_(d3) to O_(d7) are spares.Further, if O_(d40) =1, it indicates control program version-up(rewriting), and if O_(d40) =0, it indicates a temporarily adaptableprogram to reading MMP code data (for example, installing an expansionprogram of corresponding compression system together with audio datainto the device: addition).

If the decoding process program install is thus effected, the process ofselecting the reproducing output section 76 and setting the parameter isnext effected (step S62). After this, data of the data area 88₁, thatis, actual data is decoded by the decoding section 92 (step S18). Inthis case, the decoding section 92 effects the decoding processaccording to the decoding program installed in the program RAM 90. Thatis, for example, the decoding process in the decoding section 92 isdetermined only when the decoding program for specifying thecompression/expansion system such as DODCELP is installed in the programRAM 90 and the thus determined decoding process is effected. Then,decoded data is reproduced and output to the output device 78 by theselected reproducing output section 76 (step S19).

By the above reproducing process with the above construction, it becomespossible to cope with a plurality of reproducing codes simply bypreparing the program RAM 90 without preparing a plurality of decoders.That is, a large extent of expansion of functions can be attained withthe least sufficient hardware.

Further, it is possible to additionally describe a control program orthe like of the controller 66, for example, in addition to the expansionalgorithm program such as the above audio data in the option data area88₅. That is, in a case where some modification of version is made in aportion of the layer 4 or the lower layer with which the microcomputeris associated, the version-up of the hardware of the application processand the layer 5 can be attained if the content of modification isdescribed in the option data area 88₅.

Further, in FIG. 23, a case wherein all of the header areas arecollectively arranged in front of the option data area 88₅ is shown, butit is of course possible to arrange the subset header area 82₁ for audiodata in front of the audio data area 88₁.

Twelfth Embodiment

FIG. 24 shows the twelfth embodiment of the invention, comprising ascanning unit 94 and a data-reproducing unit 96 which are connected by acable. The scanning unit 94 is designed to optically read dot codes. Thedata-reproducing unit 96 is designed to process the dot code thereby toreproduce multimedia information.

The scanning unit 94 has an error information display section 72A, whichdisplays scanning errors and data-processing errors made in the scanningunit 94. Similarly, the data-reproducing unit 96 has an errorinformation display section 72B which displays errors made in thedata-reproducing process performed in the data-reproducing unit 96.

The scanning unit 94 further comprises a reading section 98 and a firsthierarchial process section 100. The reading section 98 corresponds tothe photographing-system module 32 of layer 1, which comprises a lightsource, an optical system, a CCD and the like. The first hierarchialprocess section 100 includes a reproduction equalizing module 34, aquantization module 36 and the like and is designed to convert dot codesread by the CCD, into binary data. The reading section 98 and firsthierarchial process section 100 are connected by two buses and aninterface (I/F). The first bus is a data bus to transmit the dot codedata, and the second bus is a control bus to transmit error signals andcontrol signals.

The first hierarchial process section 100 has a binary threshold-valuedetecting section 102. The section generates a over/under-exposuresignal. This signal, which indicates an error, is supplied through thecontrol bus to the error information display section 72A. Upon receiptof the signal, the section 72A causes a red LED to emit red light,indicating a scanning error has been made.

The data-reproducing unit 96 further comprises a data-reproducingsection 104. The section 104 is designed to process not only the layers2 to 5 and the application process layer. The section 104 has two buses,i.e., a data bus and a control bus. The section 104 incorporates amicrocomputer 66, which controls any other component of the section 104.The microcomputer 66 has the error processing section 70 which processeserror signals.

The error processing section 70 supplies an error signal to the errorinformation display section 72B. The section 72B displays the errorrepresented by the error signal. The error signal is supplied to theerror information display section 72A of the scanning unit 94, too,through the control bus and the interface (I/F). Thus, the section 72Adisplay the error represented by the error signal.

The error information display section 72A of the scanning section 94 hasa green LED, besides the red LED. The error information display section72B of the data-reproducing unit 96 has a liquid crystal display fordisplaying various messages in words and symbols.

FIG. 25A shows items of information which are displayed by the errorinformation display section 72A incorporated in the scanning section 94.Basically, while the scanning section 94 is operating well, the greenLED is turned on. When the section 94 makes an error, the red LED isturned on. Further, both LED can blink. Thus, when used in combination,the green LED and the red LED can indicate nine different operatingconditions of the section 96, in accordance with whether thy are turnedon or off.

FIG. 25B shows items of information which are displayed by the errorinformation display section 72B incorporated in the data-reproducingsection 96. The the section 72B has nine display units arranged in threerows and three columns, each for displaying a message in words or asymbol. The nine messages the section 72B can indicate are: (1) switchis on; (2) power supplied is sufficient; (3) the power switch is on; (4)data is being reproduced; (5) data can be read; (6) data cannot bereproduced and dot codes must be scanned again; (7) switches have beenerroneously operated;, (8) codes are meaningless (OK); and (9) data canbe read but cannot be reproduced.

Each of the error information display sections 72A and 72B can displaynine types of errors, some occurring in the scanning unit 94 and theothers occurring in the data-reproducing unit 96. Instead, the errorinformation display section 72A may display only errors which occur inthe unit 94, while the error information display section 72B may displayerrors which occur in the unit 96. Needless to say, the errorinformation display sections 72A and 72B may have means to generatesound to indicate errors occurring in the scanning unit 94 and thedata-reproducing unit 96.

This invention has been described based on the embodiments, but thisinvention is not limited to the above embodiments and can be variouslymodified without departing from the technical scope thereof. Thecontents of this invention can be summarized as follows.

(1) An information recording medium having a portion in which multimediainformation containing at least one of audio information, videoinformation and digital code data is recorded in the form of anoptically readable code pattern (10), characterized in that;

restoring means to be applied to the information recording medium, forreading the code pattern and restoring the original multimediainformation comprises:

first hierarchical processing means (32, 34, 36) for converting the codepattern thus read into code data as an image, adding informationrelating to the reading to the code data as first processinginformation, and outputting the resultant information;

second hierarchical processing means (38, 40, 42, 44, 46) forrecognizing the first processing information output from the firsthierarchical processing means, processing code data output from thefirst hierarchical processing means, creating blocks by collecting thecode data for each preset unit, and outputting the blocks;

third hierarchical processing means (48, 50, 52, 54, 56, 58) forcollecting the blocks output from the second hierarchical processingmeans, extracting second processing information at least necessary forcreating supermacro-blocks of a larger preset unit from the code data ofthe blocks, recognizing the second processing information, creatingsupermacro-blocks based on the second processing information, extractingthird information for effecting the error processing operation from thesupermacro-blocks, recognizing the third processing information,effecting the error processing operation for the supermacro-blocks basedon the third processing information, and outputting subset elementscreated by distributing the supermacro-blocks based on the thirdprocessing information;

fourth hierarchical processing means (60, 62) for extracting fourthprocessing information at least necessary for creating subsetsconstructed codes of preset unit which can permit the multimediainformation to be restored from the subset elements output from thethird hierarchical processing means and outputting subsets created basedon the fourth processing information; and

fifth hierarchical processing means (66, 74) for extracting fifthprocessing information (82₁, 82₂, 82₃, 82₅, 84) at least necessary forcreating reproducing data for reproducing and outputting the multimediainformation from the subsets output from the fourth hierarchicalprocessing means and outputting reproducing data of the multimediainformation based on the fifth processing information; and characterizedin that

the code pattern (10) contains at least the second to fifth processinginformation for executing the application process for adequatelyselecting and outputting reproducing data from the fifth hierarchicalprocessing means for the respective data types based on the fifthprocessing information.

That is, in the information recording medium described in Jpn. Pat.Appln. No. 6-121368 (International Application No. PCT/JP95/01050)corresponding to U.S. Pat. No. 5,898,709, a file is created based onfifth processing information extracted from the subsets, but in thisinvention, the fifth hierarchical processing means for outputtingreproducing data of multimedia information directly created based on thefifth information also extracted from the subsets and the applicationprocess processing means for adequately selecting and outputting thereproducing output section for reproducing and outputting reproducingdata based on the fifth processing information are provided so that thefile outputting process (creating process) in the above application canbe omitted and the processing time up to the reproduction output can bereduced.

(2) An information recording medium according to the informationrecording medium of the (1), characterized in that the fifth processinginformation extracted from the subsets output from the fourthhierarchical processing means and at least required for creatingreproducing data for reproducing and outputting the multimediainformation at least contains type information (82₁₁ a, 82₂₁ a, 82₃₁ a,82₅₁ a) indicating the type of reproducing data, position information(82₁₁ d, 82₁₁ e, 82₂₁ d, 82₂₁ e, 82₃₁ d, 82₃₁ e, 82₅₁ d, 82₅₁ e)indicating the position in which corresponding reproducing data ispresent, and parameter information (82₁₁ c, 82₂₁ c, 82₃₁ c, 82₅₁ c) forcreating parameters of the hardware necessary for the reproducingprocess.

That is, since parameters defining the content of the process and thefunction of the hardware can be directly read not only in a case whereininformation can be transferred to the next process (application) in thefile data form as in a computer but also in a case of hardware whichdoes not require the file form as in a dedicated reproducing device, theprocesses of file formation and reading of the processing content can beomitted and high-speed reproduction can be attained.

(3) An information recording medium according to the informationrecording medium of the (1), characterized in that the fifth processinginformation extracted from the subsets output from the fourthhierarchical processing means and at least required for creatingreproducing data for reproducing and outputting the multimediainformation at least contains representative information (84B) capableof collectively defining information of types of reproducing data,information indicating the position in which corresponding reproducingdata lies, and parameter information for setting respective parametersof the hardware necessary for the reproducing process.

That is, since representative information capable of collectivelydefining the type of reproducing data, position information indicatingthe position in which corresponding reproducing data lies, and parameterinformation for setting respective parameters of the hardware necessaryfor the reproducing process is provided, a parameter set correspondingto the representative information can be selected from the parameter setgroup previously held in the hardware side simply by reading therepresentative information without reading the parameters one by onefrom the code information, thereby making it possible to reduce time forthe parameter setting operation.

(4) An information recording medium according to the informationrecording medium of the (1) or (3), characterized in that the fifthprocessing information extracted from the subsets output from the fourthhierarchical processing means and at least required for creatingreproducing data for reproducing and outputting the multimediainformation contains only representative information (84A, 84D, 84E)capable of collectively defining the type of reproducing data, positioninformation indicating the position of corresponding reproducing data,and parameter information for setting respective parameters of thehardware necessary for the reproducing process.

That is, since the type of reproducing data, position informationindicating the position of corresponding reproducing data, and parameterinformation for setting respective parameters of the hardware necessaryfor the reproducing process can be omitted from the code data, areproducing data (user data) area can be increased accordingly (theredundancy is reduced and if the amount of user data is kept unchanged,the size of the code itself can be reduced).

(5) An information reproducing device for optically reading a codepattern from an information recording medium having a portion in whichmultimedia information containing at least one of audio information,video information and digital code data is recorded in the form of anoptically readable code pattern (10) and restoring the originalmultimedia information, characterized by comprising:

first hierarchical processing means (32, 34, 36) for converting the codepattern thus read into code data as an image, adding informationrelating to the reading as first processing information to the code dataand then outputting the same;

second hierarchical processing means (38, 40, 42, 44, 46) forrecognizing first processing information output from the firsthierarchical processing means to process code data output from the firsthierarchical processing means, creating blocks by collecting the codedata for each preset unit, and outputting the blocks;

third hierarchical processing means (48, 50, 52, 54, 56, 58) forextracting second processing information at least necessary for creatingsupermacro-blocks of a larger preset unit by collecting the blocksoutput from the second hierarchical processing means from the code dataof the blocks, recognizing the thus extracted second processinginformation, creating supermacro-blocks based on the second processinginformation, extracting third processing information for effecting theerror processing operation from the supermacro-block, recognizing thethus extracted third processing information, effecting the errorprocessing operation for the supermacro-block based on the thirdprocessing information, and outputting subset elements created bydistributing the supermacro-blocks based on the third processinginformation;

fourth hierarchical processing means (60, 62) for extracting fourthprocessing information at least necessary for creating subsetsconstructed by codes of a preset unit which permits the multimediainformation to be restored by use of the subset elements output from thethird hierarchical processing means from the subset element andoutputting subsets created based on the fourth processing information;

fifth hierarchical processing means (66, 74) for extracting fifthprocessing information at least necessary for creating reproducing datafor reproducing and outputting the multimedia information from thesubsets output from the fourth hierarchical processing means andoutputting reproducing data of the multimedia information based on thefifth processing information; and

application process means (66, 76) for adequately selecting andoutputting reproducing data from the fifth hierarchical processing meansfor the respective data types based on the fifth processing information.

That is, in the information reproducing device described in Jpn. Pat.Appln. No. 6-121368 (International Application No. PCT/JP95/01050), afile is created based on fifth processing information extracted from thesubsets, but in this invention, the fifth hierarchical processing meansfor outputting reproducing data of multimedia information directlycreated based on the fifth information also extracted from the subsetsand the application process processing means for adequately selectingand outputting the reproducing output section for reproducing andoutputting reproducing data based on the fifth processing informationare provided so that the file outputting process (creating process) inthe above application can be omitted and the processing time up to thereproduction output can be reduced.

(6) An information reproducing device according to the informationreproducing device of the (5), characterized in that the fifthhierarchical processing means includes:

extracting means (68) for extracting the fifth processing information atleast necessary for creating, reproducing and outputting reproducingdata for reproducing and outputting the multimedia information from thesubsets output from the fourth hierarchical processing means; and

means (68), based on the fifth processing information extracted by theextracting means, for determining whether a reproducing hardware isapplicable or not, recognizing the type of reproducing data recorded foreach preset unit, extracting position information indicating theposition of corresponding reproducing data, and parameter informationfor setting respective parameters of the hardware necessary for thereproducing process, switching (selecting) a processing section, andsetting parameters for the hardware.

That is, since parameters defining the content of the process and thefunction of the hardware can be directly read not only in a case whereininformation can be transferred to the next process (application) in thefile data form as in a computer but also in a case of hardware whichdoes not require the file form as in a dedicated reproducing device andthe parameters are set, the processes of file formation, reading of theprocessing content and extraction of parameters from the file header canbe omitted and high-speed reproduction can be attained.

(7) An information reproducing device according to the informationreproducing device of the (5), characterized in that the fifthhierarchical processing means includes:

extracting means (68A) for extracting representative information capableof collectively defining information of types of reproducing data,position information indicating the position of correspondingreproducing data, and parameter information for setting respectiveparameters of the hardware necessary for the reproducing process amongthe fifth processing information at least necessary for creating,reproducing and outputting reproducing data for reproducing andoutputting the multimedia information from the subsets output from thefourth hierarchical processing means; and

means (68), based on the representative information extracted by theextracting means, for determining whether a reproducing hardware isapplicable or not, recognizing the type of reproducing data recorded foreach preset unit, recognizing and determining position informationindicating the position of corresponding reproducing data and parameterinformation for setting respective parameters of the hardware necessaryfor the reproducing process, and selecting and setting a correspondingparameter group from the parameter groups containing switching(selection) parameters of a previously prepared processing section forthe hardware.

That is, since representative information capable of collectivelydefining the type of reproducing data, position information indicatingthe position of corresponding reproducing data, and parameterinformation for setting respective parameters of the hardware necessaryfor the reproducing process is provided, a parameter set correspondingto the representative information can be selected from the parameter setgroup previously held in the hardware side simply by reading therepresentative information without reading the parameters one by onefrom the code information, thereby making it possible to reduce time forthe parameter setting operation.

(8) An information reproducing device for optically reading a codepattern from an information recording medium having a portion in whichmultimedia information containing at least one of audio information,video information and digital code data is recorded in the form of anoptically readable code pattern (10) and restoring the originalmultimedia information, characterized by comprising:

first hierarchical processing means (32, 34, 36) for converting the codepattern thus read into code data as an image, adding informationrelating to the reading as first processing information to the codedata, and then outputting the same;

second hierarchical processing means (38, 40, 42, 44, 46) forrecognizing first processing information output from the firsthierarchical processing means to process code data output from the firsthierarchical processing means, creating blocks by collecting the codedata for each preset unit, and outputting the blocks;

third hierarchical processing means (48, 50, 52, 54, 56, 58) forextracting second processing information at least necessary for creatingsupermacro-blocks of a larger preset unit by collecting the blocksoutput from the second hierarchical processing means from the code dataof the blocks, recognizing the thus extracted second processinginformation, creating supermacro-blocks based on the second processinginformation, extracting third processing information for effecting theerror processing operation from the supermacro-block, recognizing thethus extracted third processing information, effecting the errorprocessing operation for the supermacro-block based on the thirdprocessing information, and outputting subset elements created bydistributing the supermacro-blocks based on the third processinginformation;

fourth hierarchical processing means (60, 62) for extracting fourthprocessing information at least necessary for creating subsetsconstructed by codes of a preset unit which permits the multimediainformation to be restored by use of the subset elements output from thethird hierarchical processing means from the subset element andoutputting subsets created based on the fourth processing information;

fifth hierarchical processing means (66, 74) for extracting fifthprocessing information at least necessary for creating reproducing datafor reproducing and outputting the multimedia information from thesubsets output from the fourth hierarchical processing means andoutputting reproducing data of the multimedia information based on thefifth processing information; and

application process means (66, 76) for adequately selecting andoutputting reproducing data from the fifth hierarchical processing meansfor the respective data types based on the fifth processing information;and characterized in that

the fifth hierarchical processing means includes error alarming means(70, 72) for effecting the error alarming process according to the fifthprocessing information.

That is, whether or not the device is applicable to the format type ofuser data recorded on the code (dot code) and/or whether or not thedevice is applicable to the reproducing process of user data isdetermined, and if the device is not applicable, an error alarm isissued, and if data is not yet reproduced and output, whether data isstill being processed or cannot be reproduced can be informed to theuser (operator). That is, the user interface can be improved.

(9) An information reproducing device according to the informationreproducing device of the (8), characterized in that the fifthhierarchical processing means compares the fifth processing informationwith information of a processing group which the fifth hierarchicalprocessing means previously holds and to which the fifth hierarchicalprocessing means is applicable and the error informing means informs anerror at least when the information reproducing device is not applicableto reproduction of code information.

That is, whether or not the device is applicable to the format type ofuser data recorded on the code (dot code) and/or whether or not thedevice is applicable to the reproducing process of user data isdetermined, and if the device is not applicable, an error alarm isissued, and therefore, even if data is not reproduced. a problem thatthe user (operator) will misunderstand that the scanning operation iserroneously effected and effect the scanning operation again can beprevented.

(10) An information reproducing device according to the informationreproducing device of the (8), characterized in that the error informingmeans informs an error issued when data is created in the first tofourth hierarchical processing means.

That is, since occurrence of scanning error can be informed to the user(operator) when data cannot be reproduced, the operator can immediatelystart the scanning operation again.

(11) An information reproducing device according to one of theinformation reproducing devices of the (8) to (10), characterized inthat at least the first hierarchical processing means (100) and at leastthe hierarchical processing means (104) other than the firsthierarchical processing means separately effect the error informingoperations in response to occurrence of respective errors.

That is, since the content of error can be obtained by the minimumnecessary operation at necessary timings, the information reproducingdevice can be efficiently used. That is, the operability can be enhancedand kind provision of information to the user can be attained.

(12) An information reproducing device according to the informationreproducing device of the (11), characterized in that error informationin at least the first hierarchical processing means contains informationof reading error (scanning error), erroneous operation of switches,power deficiency (including a case of disconnection).

That is, since the content of error can be obtained by the minimumnecessary operation at necessary timings, the information reproducingdevice can be efficiently used. That is, the operability can be enhancedand kind provision of information to the user can be attained. Further,by providing an alarm display for displaying the above content at leaston the scanning section having the first hierarchical processing means,it becomes possible to get information at the time of scanning, duringthe scanning or immediately after the scanning operation, thereby makingit possible to efficiently start the next operation (such asre-scanning).

(13) An information reproducing device characterized by comprising:

scanning means (94) for optically reading a code pattern from aninformation recording medium having a portion in which multimediainformation containing at least one of audio information, videoinformation and digital code data is recorded in the form of anoptically readable code pattern (10);

restoring means (96) for restoring the code pattern read by the scanningmeans into original multimedia information; and

error informing means (70, 72) for informing occurrence of error whenthe original multimedia information cannot be restored by the restoringmeans while determining whether the cause of non-reproduction is causedby an error occurring in the processing process by the scanning means orrestoring means or by the fact that the information reproducing deviceis not applicable to the code pattern read by the scanning means.

That is, when data is not reproduced, information indicating that thecause is due to the scanning error or due to the fact that the device isnot applicable for reproduction of the code data can be given to theuser (operator), and therefore, the operator can rapidly determine thenext operation (for example, operator may re-scan, operator must give upbecause the data cannot be reproduced by the device, operator mayre-scan with much attention given to the switch because the switchingoperation has been erroneously effected by the operator, operator mustreplace the battery because no power is supplied, or the like).

(14) An information reproducing device according to one of theinformation reproducing devices of the (8) to (10) and (13),characterized in that the error informing means includes at least one ofa voice message, electronic sound, mechanical sound, synthesized soundand message character display alarm lamp (color RED, color lamp or thelike) or a combination of two or more among them (such as a combinationof a plurality of alarm lamps of different colors, a combination of aplurality of messages, a combination of plural types of electronicsounds, mechanical sounds and synthesized sounds).

That is, the more concretely specified error information or informationused as criterion for determining the next operation can be given to theoperator. Particularly, provision of information indicating the scanningerror or non-applicable device is important.

(15) An information reproducing device according to the informationreproducing device of the (13), characterized in that the scanning meansand the restoring means are separately constructed;

the error informing means includes:

means (72A) provided on the scanning means, for issuing informationcorresponding to the scanning error by the scanning means and an errorcaused in the processing process; and

means (72B) provided on the restoring means, got issuing informationcorresponding to an error caused in the restoring process by therestoring means.

That is, since the content of error can be obtained by the minimumnecessary operation at necessary timings, the information reproducingdevice can be efficiently used. That is, the operability can be enhancedand kind provision of information to the user can be attained.

(16) An information reproducing device according to the informationreproducing device of the (15), characterized in that information oferror in the scanning means is based on the scanning error, operationerror of switches or the like, and deficiency of power supply (includinga case of disconnection).

That is, since the content of error can be obtained by the minimumnecessary operation at necessary timings, the information reproducingdevice can be efficiently used. That is, the operability can be enhancedand kind provision of information to the user (operator) can beattained. Further, by providing an alarm display for displaying theabove content at least on the scanning section having the firsthierarchical processing means, it becomes possible to get information atthe time of scanning, during the scanning or immediately after thescanning operation, thereby making it possible to efficiently start thenext operation (such as re-scanning).

Additional advantages and modifications will readily occur to thoseskilled in the art. Therefore, the invention in its broader aspects isnot limited to the specific details, and representative devices shownand described herein. Accordingly, various modifications may be madewithout departing from the spirit or scope of the general inventiveconcept as defined by the appended claims and their equivalents.

What is claimed is:
 1. An information reproducing device having errorinforming means, comprising:scanning means for optically reading anoptically readable code pattern from an information recording medium,the optically readable code pattern including a portion of theinformation recording medium in which multimedia information includingat least one of audio information, video information and digital codedata is recorded; reproduce/output means for reproducing and outputtingthe code pattern read by the scanning means as original multimediainformation; and error informing means for indicating, when thereproduce/output means does not reproduce and output the originalmultimedia information, an occurrence of an error so as to enable a userto determine a reason why the original multimedia information is notreproduced and output.
 2. The device according to claim 1, furthercomprising determining means for determining the reason ofnon-reproduction and output of the original multimedia information bysaid reproduce/output means, and wherein the error informing meansindicates the occurrence of the error in accordance with a determinationresult of the determining means.
 3. The device according to claim 2,wherein the determining means comprises means for determining that thecause of the error is due to at least one of (i) scanning error by thescanning means; (ii) inapplicability of the code pattern read by thescanning means to the information reproducing device; and (iii)incapability of the reproduce/output means in reproducing and outputtingthe original multimedia information.
 4. The device according to claim 3,wherein the determining means determines whether the error is due to thescanning error from the processing condition of the data correspondingto the multimedia information which is based on the code pattern read bythe scanning means.
 5. The device according to claim 3, wherein thedetermining means determines whether the code pattern read by thescanning means is inapplicable to the information reproducing device andwhether the original multimedia information is reproduced and outputfrom the reproduce/output means from header data corresponding to themultimedia information based on the code pattern read by the scanningmeans.
 6. The device according to claim 1, wherein the scanning means isconstructed to optically read the code pattern from the informationrecording medium by manual scanning.
 7. The device according to claim 1,wherein the error informing means comprises at least one of a voicemessage, an electronic sound, a mechanical sound, a synthesized sound, acharacter message display and an alarm lamp.
 8. The device according toclaim 1, wherein the code pattern is constructed by arranging aplurality of blocks, each of the blocks being constructed by arranging,according to a predetermined physical relationship, a data area made ofa plurality of dots arranged according to a content of the multimediainformation, a marker for recognizing the blocks and a block address forindicating the addresses of the blocks.